Visualizing Classification Results: Confusion Star and Confusion Gear
نویسندگان
چکیده
Recent developments in machine learning applications are deeply concerned with the poor interpretability of most these techniques. To gain some insights process designing data-based models it is common to graphically represent algorithm’s results, either their final or intermediate stage. Specially challenging task plotting multiclass classification results as they involve categorical variables (classes) rather than numeric results. Using well-known MNIST dataset and a simple neural network an example, this paper reviews existing techniques visualize from those centered on particular instance set instances, representing overall performance metric. As commonly summarized form confusion matrix, special attention paid its graphical representation. From analysis, new visualization tool derived, which presented two forms: star gear. The errors, while gear focuses hits. proposed tools also evaluated when facing: (i) balanced imbalanced classifiers issues; (ii) problem errors different orders magnitude. By using shapes instead colors value each matrix cell, significantly improve readability matrices. Furthermore, we show how area enclosed by stars gears directly related standard metrics. graphic can be usefully employed performances sequence classifiers.
منابع مشابه
Confusion Graph: Detecting Confusion Communities in Large Scale Image Classification
For deep CNN-based image classification models, we observe that confusions between classes with high visual similarity are much stronger than those where classes are visually dissimilar. With these unbalanced confusions, classes can be organized in communities, which is similar to cliques of people in the social network. Based on this, we propose a graph-based tool named “confusion graph” to qu...
متن کاملConfusion Matrix Stability Bounds for Multiclass Classification
We provide new theoretical results on the generalization properties of learning algorithms for multiclass classification problems. The originality of our work is that we propose to use the confusion matrix of a classifier as a measure of its quality; our contribution is in the line of work which attempts to set up and study the statistical properties of new evaluation measures such as, e.g. ROC...
متن کاملConfusion
Acetaminophen (paracetamol) plays a vital role in American health care, with in excess of 25 billion doses being used annually as a nonprescription medication. Over 200 million acetaminophen-containing prescriptions, usually in combination with an opioid, are dispensed annually. While acetaminophen is recognized as a safe and effective analgesic and antipyretic, it is also associated with signi...
متن کاملVisualizing confusion matrices for multidimensional signal detection correlational methods
Advances in modeling and simulation for General Recognition Theory have produced more data than can be easily visualized using traditional techniques. In this area of psychological modeling, domain experts are struggling to find effective ways to compare large-scale simulation results. This paper describes methods that adapt the web-based D3 visualization framework combined with pre-processing ...
متن کاملConfusion Matrix
A confusion matrix (Kohavi and Provost, 1998) contains information about actual and predicted classifications done by a classification system. Performance of such systems is commonly evaluated using the data in the matrix. The following table shows the confusion matrix for a two class classifier. The entries in the confusion matrix have the following meaning in the context of our study: ● a is ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2022
ISSN: ['2169-3536']
DOI: https://doi.org/10.1109/access.2021.3137630